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ABSTRACT 

The purpose of the analysis was to provide a profile 
of instructional activities related to content and referenced ta 
specified instructional outcome areas. Emghasis was placed on 
determination of four ma^or factors: (1) major outcomes in the 
program and their relative emphasis in b^oth regular and supplementary 
instructional materials, (2)l the .distrii)ution "of content within aiid 
across instructional units (ch$tpters) , (3) points in the 
instructional sequence where mastery of oatcomes is assessed^ and (^) 
the amount of independent practice in regular and supplementary 
instructional materials related directly to each m^jor outcome 
developed in the program. The content analysis was organized' by 13 
content strands and is presented in a series of tables. Table entries 
indicate tHe. grade level and page location at which each topic is 
discussed. Locations of diagnostic tests are also indicated. The 
completed analysis forms the basis fo-r preliminary specif icatioiT^f 
an application of Learning Mastery System procedures to the series. 
(Author/SD) 
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ABSTRACT x 
A content analysis was completed of the D.C. Heath matljematics 
series for elementary grades ♦ ihe purpose of the analysis was to pro- 
vide a profile of inatruetional activities related to content and 
referenced to specified instructional outcome areas. Emphasis was' 
placed on determination of: 

major outcomes in the program and their relative emphasis in 
both regular and supplementary instructional materials. 

2. the distribution of content within and across instructional 
units (chapters). . ' 

3. points in the instructional sequence where mastery of outcomes 
is assessed, 

4. the amount of independent practice in regular and supplementary 
instructional materials related directly to each major outcome 
developed in the program. 

The completed analysis forms the basis for preliminary specifica- 
tion of an application of Learning Mastery System procedures to the 
series. 



CONTENl ANALYSIS OF HEATH MATHEMATICS PROGRAM FOR ELEMENTARY GRADES K-6 
Elijah Babikian, Jim Winchester and Aaron Buchanan 

This document describes a content analysis of the Heath mathematics 
series for elementary grades. The document is divided into three 
sections as follows: 

Description of the Analysis , Procedures used by staff members of 
the Southwest Regional Laboratory for Educational Research and Develop- 
ment (SWRL) in performing the analysis are described. These procedures 
were used to generate descriptors of instructional outcomes from index 
entries in the Heath teacher's editions and to determine the location 
of instructional and evaluation activities relevant to these outcomes 
in various Heath components. 

Interpretation of the Analysis « Procedures are recommended for 
identifying relationships in the analysis table between content organi- 
zation, evaluation of outcomes, an^ provisions for individual practice, 
and for comparing these relationships with those desired in an applica- 
tion of a Learning Mastery System. 

Preliminary Specifications of a Learning Mastery System Application . 
Broad preliminary specifications for the architecture of an application 
of a Learning Mas.tery System to the Heath series are presented. These 
specifications include: (1) a discrete number of broad instructional 
outcomes that can serve as a unifying structure for assessing pupil , 
progress through various levels^ of the program, (2) suggested evaluation 
components, and (3) materials suitable for individual practice on 



oa<:comes assessed in IMS throu^out the program. 

DESCRIPTION OF THE ANALYSIS 

L 

CONTENT STRANDS 

The analysis is organized around twelve vertical strands of content 

identified by Heath as basic units of a program structure. These strands 

are listed below in the order of their appearance in the .program scope 

and sequence chart in each teacher's edition. 

Structure 
Sets 



Numeration 
Number^ 

Number sen^tences 

Addition and subtraction 

Multiplication and division 

Geometry 

Measurement 

Functions! 

Problem solving and applications 
Probability and statistics 
NSrefec^ theory 



OUTCOME DESCRIPTORS 

For each strand and substrand, a set of outcome descriptors has 
been prepared by SWRL staff to describe 'the content at each level of 
the program. These (descriptors are statements of expected outcomes of 
instruction, A set pf dorscriptors from the "Ntnnber and Numeration" 
strand in Level 5 is shown below. 

1« Read and write numerals 
To thousands 

To hundred thousands ^ * ,^ 
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In levels 5 and 6 "Numeration" and "Number" are combined into one 
strand, and "Functions" is introduced. 




To millions 
To billions 



2\ State the place-value of a digit 



In whole numbers 

Iti decimal fractions 

3. Represent numerals in different forms ? 

Expanded form 
Standard form 
Exponential form 

4. Recqjinize fractional numbers in common form 

Equivalent fractions* 

Improper fractions .. ^ 

Mixed numeral's 

5. delate fractional numbers in common .form to 

Whole numbers 
Mixed numerals 

Fractional numbers in decimal *fc5rm 
• ^/-^^tcome descriptors were derived using the following procedures: 
I 1. All entries in the index of -the teacher's edition were part 

titioned according to content strands listed in the scope and, sequence 

• * ^ ^ V 

chart., Since scope and 'sequence entries overlapped somewhat between 
Strands, elementary priorities- in classification were followed which 
eliminated most of the multiple listing of index entries. 

2. Within each strand, 'indeJc, entries were translated into a small 
set of statements of intended mathem"atical behaviors (outcome descrip- 
tors). In some instances, the des^triptors are comprehensive, and no 
subordinate outcomes are included; in other insTtances, subordinate 
outcomes are included because major portions of the instructional 
materials were devoted to their review.' 
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TABLE ENTRIES 

Instructional activities (designated lessons) Sxotn the core com-' 
ponents of the Heath program were classified accord!jlng to the pre- 
specified outcome, descriptors. Since the purpose of the analysis was 
to 'obtain a profile of instructional activities, an exhaustive listing 
of all activities included in all components was not necessary. The 
components used were the student text (teacher* s edition), the basic 
worksheets and a separate battery of diagnostic tests ♦ Supplementary 
worksheets were not included because they do not present the basic 
concepts and skills io the s^e setting as the textbook, and they are 
not Intended for remediation. , A description of all supplementary program 
components is in Appendix A. * " \ ' . 

Entries in the table are page numbers in the student text, work- 
book, and diagnostic test batteries where Instructional activities 
pertinent to the outcome descriptor are located* For each entry, Xhe 
nunfber of jLtems or problems directly related to the outcome descriptor 
was determined. It was reasoned that i|:em frequencies directly related 
to an outcome descriptor are better indicators of the amount of inde- 
pendent practice provided in a chapter fo^^each outcome than are page 

entries. In determiniag item frequencies, the number ten was chosen 

\ 

as a cutoff point since most instructional activities related princi- 
pally to major outcomes contained at least ten items of tji^actice. An 
entry of (10) following a set of page entries indicated that tensor 
more ^tems providing direct practice on the outcome were found in the 
chapter. • 
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During the course of the analysis, it became necessary to develop 
conventions for determining item frequencies. Items were counted 
according to the number of separate responses requiring direct outcome- 
related performances. In some instances, such as the reproduction of 
counting sequences, individual responses were not independent of each 
other. In this case, each separate sequence was counted as a response. 
In many instances, mastery of a particular outcome, such as recognition 
of commutativity of addition, would, be helpful in making a response, 
but unnecessary. Where responses could be made as a result of acquisi- 
tion of some other outcome, especially an outcome that is learned rather 
early in the instructional sequence (such as recognition of number 
facts), no items were recorded with the descriptor. Conventions were 
also developed fpr classifying problems in activities involving either 
number line or semi-concrete pictorial models to solve equations. While 
use of the model might be helpful in making a required response, it was-^ 
seldom required that the model be interpreted; a recall of basic number 
facts or the application of some computation algorism was usually 
sufficient. In instances such as these, an item was recorded for pur- 
-poses of the analysis with a descriptor involving "models" if there were 
separate representations of the model for each equation. 

Actual entries for a particular descriptor are coded as follows: 

1. Pages from the student text (or student pages from the 
teacher's edition) appear in regular typeface with the number of items, 
to 10, following in parentheses. 

2. Pages from the student workbook and the number .of related 

■• . ■ 7 



items, to 10, are underlined. 

3. Diagnostic test entries are preceded by DT with the number of 
the test and the number df items related to the descriptor following. 

INTERPRETATION OF THE ANALYSIS 

CONTENT STRANDS 

The distri^tion of content in the program can be inferred from 
the analysis in the following ways: 

1 . Examination of Instruction and Evaluation Entries for a 
Particular Outcome Across Chap€efg"^tid Levels . It is possible to draw 
some conclusions concerning t.he independence of one outcome from another 
If there are several instructional entries, but few review or evaluation 
entries, it is possible to infer that this outcome cannot be easily 
separated from other outcomes during instruction. This inference is 
related to methods used in development of the analysis. The major 
source of instruction entries (textbook) was the index of teacher's 
editions at each level. Since index entries are likely to be classified 
with as many content domains as are possibly relevant, there v^as some 
multiple claf^sif ication among instructional entries. Review, and eval- 
uatiqn entries, on the other hand, were made from a page-by-page analysij 
of the components. *In^this case, multiple classification was avoided 
wherever possible, and activities were referenced to the outcome with 
the most appropriate descriptor. 

2. Examination of Entries in the Chapter Columns . For purposes 
of a Learning Mastery System, it is desirable that contient included in 



7 

s 

each chapter be reasonably homogeneous. Unit division should be de- 

i 

termined primarily by outcomes to be acquired and their presentation 
sequence. The instructional entries in each chapter should be spread 
over no more than 7 or 8 outcomes if evaluation of mastery is to 
retain some reliability and tests are to remain a reasonable length. 
Where chapters in Heath provide instruction on more outcomes than thi^, 
it may be necessary to defer assessment of some outcomes until they 
are represented in a subsequent chapter. 

" — ' 3. Examination of all Descriptors for a Particular Content Strand 
over all Levels of the Program . If there are very, few descriptors 
that differ distinctly, or if the set of descriptors show little 
hierarchical relationship, the strand probably does not possess strong 
sequential characteristics of its own. Freq uently, as in "Prob lem 
Solving and Application", the strand exists primarily for the inclusion 
of activities where mathematical skills are applied to verbal or 
pictorial problems. Some strands, sucl\ as» "Se^s" in Levels K-3, exist 
principally as a model for whole numbers and related operations. . By 
comparison, material devoted directly to the development of concepts 
related to sets and set theory is relatively minor. 

OUTCOME ASSESSMENT 

Instructional entries frequently occur in the analysis with no 
accompanying evaluation entries. In general, this cir<<«nT^tance im- 
plies one of the following: 

1. Evaluation is deficient. 

2. Instruction is primarily in the form of teacher explanation 
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^ with little or no independent practice for the pupil., ^ 

\ 

3. Instruction and ^practice on a particular outcome cannot be 
separated, from a more inclusive outcome. 

4. The outcome is minor in comparison to the amount of instruc- 
tion given on other skills presented in the unit. 



The number of items per skill-per unit averages 3-4 for 
skills and 1-3 for minor skills. Item frequencies such as ^he|| may 
be adequate in skill 'maintenance or retention, but should prob|bly be 
increased in criterion exercises where acquistion of new or ext^pded 
skills is assessed. ^ . ' 



INDEPENDENT PRACTICE 

The amount of ^independent practice on each outcome can^be d^- 

|-r 

termined by attending to the numbers in parentheses following under- 
lined and non-underlined page entries. Of primary interest are , 

- I 

^.nstances where instructional entries (regular instruction and reyi^ew) 
are associated with fewer than ten items 9f independent practice. 
The number ten was chosen as a reference point for the analysis since 



many activities approached but did not exceed this number. It was 



reasoned that outcomes with fewer than ten items of practice, and ^ 
particularly outcomes with fewer trian five or six items, do. not pro- ^ 
vide sufficient practice for attainment of the skill. 



PRELIMINARY SPECIFICATIONS OF A LEARNING MASTERY SYSTEM APPLICATION 
CONTENT STRANDS 

The 'strands of content jrelated to the arithmetic of whole and 4 
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rational numbers are dominants This may be inferred by inspecting the 
number of outcomes developed (as represented by outcome descriptors) 
and the number of instructional entries per outcome. Outcomes develop- 
ed in these strands, as well as most of their substrands, usually 
include at least 10 items of independent practice^. Strands such as 
"Number Sentences'' and "Number Theory", contain so many outcome descrip- 
tors in common with other strands that it is doubtful their preserve- 
tion as independent outcome areas in a Learning Mastery System would be 
worthwhile. 

INSTRUCTIONAL OUTCOMES 

Fi^e or six broad outcomes such as the following^ likely will be 
recommended as a basic outcome structure for the development of 
Learning Mastery System procedures: 

1. Recognize basic elements and concepts 

2. Decode systems of symbols 

3. Express mathematical relationships 

4. ' Verify mathematical relationships > . 

5. Perform operations 

6. Solve verbal problems 

One or more of these oaitcomes. represent major skills to be develop- 
ed in each of content domains such as the following: 
I. Sets 

II- Whole numbers ♦ 

V- 

III. Rational numbers (positive) - 
IV. Integers 
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V. Geometry 
VI, Measurement 
VII. Logic 

Pupil progress through broad instructional sequences for outcomes 
applicable to each content domain will be monitored throughout the 
progrean. At each level, a set of outcome descriptors will further 
refine cells in the outcome-content matrix to reflect all of the 
content included in the program for that level. 

EVALUATION COMPONENTS ^ * 

In 'aT number of instances recognition of properties of mathemati- 
cal operations is introduced through verbal instructions given by the 
teacher. Pupils are encouraged but not Required to recognize these 
properties in solving* rela^ted equations or problems. AcquisitijK^^f 
skills such as these should not be assessed in a Learning MastJery 
System until approximately 10 items of independent practice haVe been 
provided in a single chapter. 

In chapters where no instruction on new outcomes is begun, the 
principal outcomes under review will be evaluated. The context for 
evaluation should include settings which parallel those used during 
regular instruction, but they should also include some transfer settings 
which may be generally familiar to the pupil but not in association with 
the outcome under development. In general, there should not l(^^^more 
than two ot three item fi^R g Ju^e latter type forsany particular outcome 




developed in a chapterT 

LMS evalu^^iorw:omponent8 for each level of Heath should include 
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the following: ^ 

1. Four to Six Pretests for Each Level > The number of pretests 
will' be determined by the numfeer of major breaks. in the- continuity of 
'the instructional sequence^ It will not be necessary to develop a 
pretest for each chapter, since many follow directly from the previous 
chapter. Essentially, all of the information which might be of value 
to the teacher can be obtained from posttest or criterion exercise 
instrlinents for the previous unit. Pretests should provide a compre- 
hensive sample of behaviors that are prerequisite to the major skills 
developed in the f^hapter. The information obtained from the pretesti 
should guide the teacher in determining the relative emphasis to be 
given any prerequisite behaviors which are reviewed prior to the intro- 
duction of new material. 

• ; 1 - ■ ■ ■ 

2. En-route Assessment De>>ice^^or Each Major Outcome Introduced 
or Reviewed , A limited number of problems In- the regular daily 
assignment will be identified which the teacher can review as a check 
on the progress of the pupil toward mastery of the outcome, 

3. End-of-Unit Criterion Exercise for Each Unit ,' Each exercise 
should include at least one» section for each of the. major outcomes on 
which instruction was provided in that unit. Approximately 4-5 items 
should be included for each individual outcome representing material 
which .has been introduced or extended. One pr two items should be 
included for each descriptor where previously mastered skills' have been 
reviewed ot maintained. 

Each exercise should include a limited number of problems where 
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computational skills which have been developed are applied to the 
solution of verbal problems. The^format for all items on the criterion 
exercise should be multiple choice with at least some of the distractors 
representing typical errors which might be made on this type of problem. 

SWRl4-developed instriiments are recommended over existing Heath 
Diagnostic Tests for th^ following reasons: 

(1) Heath Diagnostic Tests are not clearly organized around in-^ 
structional outcomes. 

(2) ^ Many outcome areas are evaluated with fewer than 4 items per 
instrument. 



(3) The constructed response format used with items^/is incompatible 
with machine scoring and remedial practice based on typical errors. 

(4) Separate Diagnostic Tests are not available for Levels K-*2. 

PRACTICE COMPONENTS 

Appropriate material should be developed for all levels. Biey 
will provide practice exercises in the same setting as the textbook. 
These exercises should be constructed tn such a way that teachers can 
select exercises on the basis of major types of errors committed. 

SUPPORT COMPONENTS . - 

Various support components, including a technical manual and 
appropriate reqord keeping materials will also be provided. 
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APPENDIX A 

t 

DESCRIPTION OF HEATH COMPONENTS 

Heath has designed the set of student's text and accompanying 
teacher's edition to serve as the core of the mathematics program. A 
number of additional components are available as follows: 

(1) Diagnostic Tests -A battery of tests, averaging 30-40 items 
per test, is provided on duplicating masters for Levels 3-6. Each 
test is designed to measure the instructional outcomes of a chapter. 
Three other tests measure the cumulative outcomes of several consecutive 
chapters. Test items run parallel to the instructional activities in 
the textbook. 

(2) Basic Worksheets -Remedial practice exercises for Levels 1-6* 
are provided to assist the slower student to understand the basic 
mathematical concepts and increase his proficiency in computational 
skills. The exercises are correlated to the student's textbook, and 
they are also available on duplicating masters. 

(3) Supplementary Worksheets -Enrichment exercises for Levels 1-6 
are provided to assist the average and better students extend the 
topics presented in the textbook to a new setting. They are available 
in workbooks and on duplicating masters. ' 



*Basic Worksheets for Levels 1-3 were not received from the publisher 
in time to be included in the analysis. 
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CONTENT Analysis 
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